Asymptotic period of an aperiodic Markov chain and the strong ratio limit property
نویسنده
چکیده
We introduce the concept of asymptotic period for an irreducible and aperiodic discrete-time Markov chain on a countable state space. If the chain is transient its asymptotic period may be larger than one. We present some sufficient conditions and, in the more restricted setting of birth-death processes, a necessary and sufficient condition for asymptotic aperiodicity . It is subsequently shown that a birth-death process has the strong ratio limit property if a related birth-death process is asymptotically aperiodic. In the general setting a similar statement is not true, but validity of the converse implication is posed as a conjecture.
منابع مشابه
ADK Entropy and ADK Entropy Rate in Irreducible- Aperiodic Markov Chain and Gaussian Processes
In this paper, the two parameter ADK entropy, as a generalized of Re'nyi entropy, is considered and some properties of it, are investigated. We will see that the ADK entropy for continuous random variables is invariant under a location and is not invariant under a scale transformation of the random variable. Furthermore, the joint ADK entropy, conditional ADK entropy, and chain rule of this ent...
متن کاملThe Rate of Rényi Entropy for Irreducible Markov Chains
In this paper, we obtain the Rényi entropy rate for irreducible-aperiodic Markov chains with countable state space, using the theory of countable nonnegative matrices. We also obtain the bound for the rate of Rényi entropy of an irreducible Markov chain. Finally, we show that the bound for the Rényi entropy rate is the Shannon entropy rate.
متن کاملMarkov shift in non-commutative probability -II
We study asymptotic behavior of a Markov semigroup on a von-Neumann algebra by exploring a maximal von-Neumann subalgebra where the Markov semigroup is an automorphism. This enables us to prove that strong mixing is equivalent to ergodic property for continuous time Markov semigroup on a type-I von-Neumann algebra with center completely atomic. For discrete time dynamics we prove that an aperio...
متن کاملAbsorbing Markov Chain Models to Determine Optimum Process Target Levels in Production Systems with Rework and Scrapping
In this paper, absorbing Markov chain models are developed to determine the optimum process mean levels for both a single-stage and a serial two-stage production system in which items are inspected for conformity with their specification limits. When the value of the quality characteristic of an item falls below a lower limit, the item is scrapped. If it falls above an upper limit, the item is ...
متن کاملStrong Consistency of Multivariate Spectral Variance Estimators in Markov Chain Monte Carlo
Markov chain Monte Carlo (MCMC) algorithms are used to estimate features of interest of a distribution. The Monte Carlo error in estimation has an asymptotic normal distribution whose multivariate nature has so far been ignored in the MCMC community. We present a class of multivariate spectral variance estimators for the asymptotic covariance matrix in the Markov chain central limit theorem and...
متن کامل